Covariance matrix estimation under data-based loss

Optimal estimation of a large-dimensional covariance matrix under Stein's loss

This paper revisits the methodology of Stein (1975, 1986) for estimating a covariance matrix in the setting where the number of variables can be of the same magnitude as the sample size. Stein proposed to keep the eigenvectors of the sample covariance matrix but to shrink the eigenvalues. By minimizing an unbiased estimator of risk, Stein derived an ‘optimal’ shrinkage transformation. Unfortuna...

Estimation of Covariance Matrix

Estimation of population covariance matrices from samples of multivariate data is important. (1) Estimation of principle components and eigenvalues. (2) Construction of linear discriminant functions. (3) Establishing independence and conditional independence. (4) Setting confidence intervals on linear functions. Suppose we observed p dimensional multivariate samples X1, X2, · · · , Xn i.i.d. wi...

Robust Covariance Matrix Estimation with Data-Dependent VAR Prewhitening Order

Joint mean and covariance estimation with unreplicated matrix - variate data ∗

It has been proposed that complex populations, such as those that arise in genomics studies, may exhibit dependencies among observations as well as among variables. This gives rise to the challenging problem of analyzing unreplicated high-dimensional data with unknown mean and dependence structures. Matrixvariate approaches that impose various forms of (inverse) covariance sparsity allow flexib...

Estimation of the Covariance Matrix of Large Dimensional Data

This paper deals with the problem of estimating the covariance matrix of a series of independent multivariate observations, in the case where the dimension of each observation is of the same order as the number of observations. Although such a regime is of interest for many current statistical signal processing and wireless communication issues, traditional methods fail to produce consistent es...